Voice controlled media playback system based on user profile

ABSTRACT

Disclosed herein are systems and methods for receiving a voice command and determining an appropriate action for the media playback system to execute based on user identification. The systems and methods receive a voice command for a media playback system, and determines whether the voice command was received from a registered user of the media playback system. In response to determining that the voice command was received from a registered user, the systems and methods configure an instruction for the media playback system based on content from the voice command and information in a user profile for the registered user.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application claims priority to (i) U.S. Provisional App.62/298,433, filed Feb. 22, 2016, titled “Room-corrected VoiceDetection,”; (ii) U.S. Provisional App. 62/298,439, filed Feb. 22, 2016,titled “Content Mixing,”; (iii) U.S. Provisional App. 62/298,425, filedFeb. 22, 2016, titled “Music Service Selection,”; (iv) U.S. ProvisionalApp. 62/298,350, filed Feb. 22, 2016, titled “Metadata exchangeinvolving a networked playback system and a networked microphonesystem,”; (v) U.S. Provisional App. 62/298,388, filed Feb. 22, 2016,titled “Handling of loss of pairing between networked devices,”; and(vi) U.S. Provisional App. 62/298,393, filed Feb. 22, 2016, titled“Action based on User ID,”. The entire contents of the 62/298,433;62/298,439; 62/298,425; 62/298,350; 62/298,388; and 62/298,393applications are incorporated herein by reference. This application alsoincorporates herein by reference the entire contents of (i) U.S.Provisional App. 62/298,410, filed Feb. 22, 2016, titled “DefaultPlayback Device(s)”; (ii) U.S. Provisional App. 62/298,418, filed Feb.22, 2016, titled “Audio Response Playback”; and (iii) U.S. ProvisionalApp. 62/312,350, filed Mar. 23, 2016, titled “Voice Control of a MediaPlayback System.”

FIELD OF THE DISCLOSURE

The disclosure is related to consumer goods and, more particularly, tomethods, systems, products, features, services, and other elementsdirected to media playback or some aspect thereof.

BACKGROUND

Options for accessing and listening to digital audio in an out-loudsetting were limited until in 2003, when SONOS, Inc. filed for one ofits first patent applications, entitled “Method for Synchronizing AudioPlayback between Multiple Networked Devices,” and began offering a mediaplayback system for sale in 2005. The Sonos Wireless HiFi System enablespeople to experience music from many sources via one or more networkedplayback devices. Through a software control application installed on asmartphone, tablet, or computer, one can play what he or she wants inany room that has a networked playback device. Additionally, using thecontroller, for example, different songs can be streamed to each roomwith a playback device, rooms can be grouped together for synchronousplayback, or the same song can be heard in all rooms synchronously.

Given the ever growing interest in digital media, there continues to bea need to develop consumer-accessible technologies to further enhancethe listening experience.

BRIEF DESCRIPTION OF THE DRAWINGS

Features, aspects, and advantages of the presently disclosed technologymay be better understood with regard to the following description,appended claims, and accompanying drawings where:

FIG. 1 shows an example media playback system configuration in whichcertain embodiments may be practiced;

FIG. 2 shows a functional block diagram of an example playback device;

FIG. 3 shows a functional block diagram of an example control device;

FIG. 4 shows an example controller interface;

FIG. 5 shows an example plurality of network devices;

FIG. 6 shows a function block diagram of an example network microphonedevice;

FIG. 7 shows an example method according to some embodiments.

FIG. 8 shows another example method according to some embodiments.

The drawings are for the purpose of illustrating example embodiments,but it is understood that the inventions are not limited to thearrangements and instrumentality shown in the drawings.

DETAILED DESCRIPTION I. Overview

Listening to media content out loud can be a social activity thatinvolves family, friends, and guests. Media content may include, forinstance, talk radio, books, audio from television, music stored on alocal drive, music from media sources (e.g. Pandora® Radio, Spotify®,Slacker®, Radio, Google Play™, iTunes Radio), and other audiblematerial. In a household, for example, people may play music out loud atparties and other social gatherings. In such an environment, people maywish to play the music in one listening zone or multiple listening zonessimultaneously, such that the music in each listening zone may besynchronized, without audible echoes or glitches. Such an experience maybe further enriched when people can use voice commands to control anaudio playback device or system. For example, a person may wish tochange the audio content, playlist, or listening zone, add a music trackto a playlist or playback queue, or change a playback setting (e.g.play, pause, next track, previous track, playback volume, and EQsettings, among others).

Listening to media content out loud can also be an individualexperience. For example, an individual may play music out loud forthemselves in the morning before work, during a workout, in the eveningduring dinner, or at other times throughout the day at home or at work.For these individual experiences, the individual may choose to limit theplayback of audio content to a single listening zone or area. Such anexperience may be further enriched when an individual can use a voicecommand to choose a listening zone, audio content, and playbacksettings, among other settings.

Identifying the person trying to execute the voice command can also bean important element of the experience. It may be desirable to execute avoice command based on who the person is and what the person wants themedia playback device or system to do. By way of illustration, at aparty or a social gathering in a household, the host or household ownermay want to prevent certain guests from using a voice command to changethe audio content, listening zone, or playback settings. In some cases,the host or household owner may want to allow certain guests to usevoice commands to change the audio content, listening zone, or playbacksettings, while preventing other guests from making such changes. Useridentification based on user profiles or voice configuration settingscan help distinguish a household owner's voice from a guest's voice.

In another example, user identification can be used to distinguish anadult's voice from a child's voice. In some cases, the household ownermay want to prevent a child from using a voice command to listen toaudio content inappropriate for the child. In other cases, a householdowner may want to prevent a child from changing the listening zone, orplayback settings. For example, the household owner may want to listento audio content at a certain volume and prevent a child from changingthe volume of the audio content. User identification may help setparental control settings or restriction settings that would prevent achild from accessing certain content or changing the listening zone, orplayback settings. For example, user identification based on userprofiles or voice configuration settings may help determine who thechild is, what the child is allowed to listen to, or what settings thechild is allowed to change.

In yet another example, user identification may be used to preventunintentional voice commands. For example, the household owner may wantto prevent audio from the television or any other audio content fromunintentionally triggering a voice command. Many other examples, similarand different from the above, are described herein and illustratedifferent types of actions based on voice recognition.

Some embodiments described herein include a media playback system (orperhaps one or more components thereof) receiving a voice command anddetermining an appropriate action for the media playback system toexecute based on user identification.

One aspect includes receiving a voice command for a media playbacksystem. In some embodiments, the media playback system includes one ormore media playback devices alone or in combination with a computingdevice, such as a media playback system server. In some embodiments, themedia playback system may include or communicate with a networkedmicrophone system server and one or more network microphone devices(NMDs). In some embodiments, the media playback system server and/or thenetworked microphone system server may be cloud-based server systems.Any one or a combination of these devices and/or servers may receive avoice command for the media playback system.

In some embodiments, one or more functions may be performed by thenetworked microphone system individually or in combination with themedia playback system. In some embodiments, receiving a voice commandincludes the networked microphone system receiving a voice command viaone or more of NMDs, and transmitting the voice command to the mediaplayback system for further processing. In some embodiments, the mediaplayback system may then convert the voice command to an equivalent textcommand, and parse the text command to identify a command. In someembodiments, the networked microphone system may convert the voicecommand to an equivalent text command and transmit the text command tothe media playback system to parse the text command and identify acommand.

A voice command may be a command to control any of the media playbacksystem controls discussed herein. For example, in some embodiments, thevoice command may be a command for the media playback system to playmedia content via one or more playback devices of the media playbacksystem. In some embodiments, the voice command may be a command tomodify a playback setting for one or more media playback devices of themedia playback system. Playback settings may include, for example,playback volume, playback transport controls, music source selection,and grouping, among other possibilities.

After receiving a voice command, the computing device of the mediaplayback system determines whether the voice command was received from aregistered user of the media playback system. In some embodiments, themedia playback system may be registered to a particular user or one ormore users in a household. In some embodiments, the computing device ofthe media playback system may be configured to link or associate a voicecommand to a registered user based on user profiles stored in thecomputing device. A registered user or users may have created a userprofile stored in the computing device. The user profile may containinformation specific to the user. For example, the user profile maycontain information about the user's age, location, preferred playbacksettings, preferred playlists, preferred audio content, accessrestrictions set on the user, and information identifying the user'svoice, among other possibilities.

In some embodiments, the computing device of the media playback systemmay be configured to link or associate a voice command to a user basedon voice configuration settings set by a user. In some embodiments, themedia playback system may ask a user to provide voice inputs or a seriesof voice inputs. The computing device of the media playback system maythen process the voice inputs, associate the voice inputs to the user,and store the information so that the media playback system canrecognize voice commands from the user.

In some embodiments, the computing device of the media playback systemmay be configured to determine a confidence level associated with avoice command, which may further help determine that the voice commandwas received from a registered user. A confidence level may bedetermined based on user history, location, individually or incombination with any other information generally found in a userprofile.

In response to determining that the voice command was received from aregistered user, the computing device of the media playback system mayconfigure an instruction or a set of instructions for the media playbacksystem. The instructions may be based on content from the voice commandand information in a user profile for the registered user. Additionallyor alternatively, the instructions may be based on content from thevoice command and voice configuration settings stored on the computingdevice.

In some embodiments, the content from the voice command may include acommand for one or more playback devices to play media content. In someembodiments, based on the command for one or more playback devices toplay media content and information in a user profile for the registereduser, the computing device of the media playback system may configure aninstruction or a set of instructions to cause one or more playbackdevices to obtain media content from a preferred media source of aregistered user. In some embodiments, based on the command for one ormore playback devices to play media content and information in a userprofile for the registered user, the computing device may configure aninstruction or a set of instructions to cause the media playback systemto play the media content via one or more playback devices of the mediaplayback system. In some embodiments, based on the command for the oneor more playback devices to play media content and information in a userprofile for the registered user, the computing device may includeinstructions to (i) configure the one or more playback devices with oneor more of the registered user's preferred playback settings and (ii)cause the one or more playback devices to play the media content via themedia playback system with the registered user's preferred playbacksettings.

In some embodiments, the content from the voice command may include acommand for one or more playback devices to play media content but maynot identify a particular listening zone or playback zone of the mediaplayback system. Based on the content from the voice command andinformation in a user profile for the registered user, the computingdevice may configure an instruction or a set of instructions to causeone or more playback devices to play the media content via one or moremedia playback devices within the particular playback zone of the mediaplayback system.

In some embodiments, the content from the voice command may include acommand for the media playback system to modify a playback setting.Based on the content from the voice command and information in a userprofile for the registered user, the computing device may configure aninstruction or a set of instructions to cause the media playback systemto modify the playback setting for one or more playback devices of themedia playback system.

Some embodiments include the media playback system determining an orderof preference to resolve conflicting voice commands received fromdifferent users. A conflicting voice commands may be, for example, avoice command received from a user to play a song and a subsequent voicecommand received from another user to stop playing the song. Many otherexamples, similar and different from the above, are described herein. Insome embodiments, the media playback system may assign an order ofpreference in which voice commands received from registered guests havea higher priority than nonregistered guests.

Additionally, the media playback system may take actions based onreceiving a wakeup word or wakeup phrase, associated with a registereduser or a registered guest user. A wakup word or wakeup phrase (e.g.,“Hey Sonos”) may be used to trigger a time period during which thesystem will accept additional commands from a user based on the specificcommand or wakeup word received. For example, a host or authorized guestmay send a voice command to add songs to a play queue (e.g., “Hey Sonos,let's queue up songs”), which may open a time period or window (e.g., 5minutes) for the host or authorized guest to send additional voicecommands to add specific songs to a play queue. Many other examples,similar and different from the above, are described herein.

After configuring an instruction or set of instructions for the mediaplayback system, some embodiments of the computing device may send theinstruction or set of instructions to one or more playback devices ofthe media playback system.

Some embodiments include the computing device of the media playbacksystem determining whether the voice command was received from a child.In some embodiments, the computing device may distinguish between anadult and a child based on information in a user profile or a guestprofile. In some embodiments, the computing device may distinguishbetween an adult and a child based on the tone or frequency of theuser's voice.

In response to determining that the voice command was received from achild, some embodiments may prevent one or more playback devices fromplaying given media that may be inappropriate for the child. Someembodiments may prevent the computing device and/or one or more playbackdevices from modifying a playback setting based on the content of achild's voice command.

Some embodiments include actions based on determining whether a voicecommand was received from a guest user instead of a registered user ofthe media playback system. In some embodiments, a registered user mayhave created a guest profile for the guest user. The guest profile mayinclude any information included in a user profile. In some embodiments,the computing device of the media playback system may determine that avoice command was not received from a registered user, and may then askthe registered user if the voice command came from a guest of theregistered user.

In response to determining that the voice command was received from aguest user, the computing device of the media playback system may (1)assign a restriction setting for the guest user, (2) configure aninstruction for one or more playback devices based on content from thevoice command and the assigned restriction setting for the guest user,and (3) send the instruction to one or more playback devices. Arestriction setting may be any setting that limits the control of themedia playback system.

While some examples described herein may refer to functions performed bygiven actors such as “users” and/or other entities, it should beunderstood that this is for purposes of explanation only. The claimsshould not be interpreted to require action by any such example actorunless explicitly required by the language of the claims themselves. Itwill be understood by one of ordinary skill in the art that thisdisclosure includes numerous other embodiments.

II. Example Operating Environment

FIG. 1 shows an example configuration of a media playback system 100 inwhich one or more embodiments disclosed herein may be practiced orimplemented. The media playback system 100 as shown is associated withan example home environment having several rooms and spaces, such as forexample, a master bedroom, an office, a dining room, and a living room.As shown in the example of FIG. 1, the media playback system 100includes playback devices 102-124, control devices 126 and 128, and awired or wireless network router 130.

Further discussions relating to the different components of the examplemedia playback system 100 and how the different components may interactto provide a user with a media experience may be found in the followingsections. While discussions herein may generally refer to the examplemedia playback system 100, technologies described herein are not limitedto applications within, among other things, the home environment asshown in FIG. 1. For instance, the technologies described herein may beuseful in environments where multi-zone audio may be desired, such as,for example, a commercial setting like a restaurant, mall or airport, avehicle like a sports utility vehicle (SUV), bus or car, a ship or boat,an airplane, and so on.

a. Example Playback Devices

FIG. 2 shows a functional block diagram of an example playback device200 that may be configured to be one or more of the playback devices102-124 of the media playback system 100 of FIG. 1. The playback device200 may include a processor 202, software components 204, memory 206,audio processing components 208, audio amplifier(s) 210, speaker(s) 212,a network interface 214 including wireless interface(s) 216 and wiredinterface(s) 218, and microphone(s) 220. In one case, the playbackdevice 200 may not include the speaker(s) 212, but rather a speakerinterface for connecting the playback device 200 to external speakers.In another case, the playback device 200 may include neither thespeaker(s) 212 nor the audio amplifier(s) 210, but rather an audiointerface for connecting the playback device 200 to an external audioamplifier or audio-visual receiver.

In one example, the processor 202 may be a clock-driven computingcomponent configured to process input data according to instructionsstored in the memory 206. The memory 206 may be a tangiblecomputer-readable medium configured to store instructions executable bythe processor 202. For instance, the memory 206 may be data storage thatcan be loaded with one or more of the software components 204 executableby the processor 202 to achieve certain functions. In one example, thefunctions may involve the playback device 200 retrieving audio data froman audio source or another playback device. In another example, thefunctions may involve the playback device 200 sending audio data toanother device or playback device on a network. In yet another example,the functions may involve pairing of the playback device 200 with one ormore playback devices to create a multi-channel audio environment.

Certain functions may involve the playback device 200 synchronizingplayback of audio content with one or more other playback devices.During synchronous playback, a listener will preferably not be able toperceive time-delay differences between playback of the audio content bythe playback device 200 and the one or more other playback devices. U.S.Pat. No. 8,234,395 entitled, “System and method for synchronizingoperations among a plurality of independently clocked digital dataprocessing devices,” which is hereby incorporated by reference, providesin more detail some examples for audio playback synchronization amongplayback devices.

The memory 206 may further be configured to store data associated withthe playback device 200, such as one or more zones and/or zone groupsthe playback device 200 is a part of, audio sources accessible by theplayback device 200, or a playback queue that the playback device 200(or some other playback device) may be associated with. The data may bestored as one or more state variables that are periodically updated andused to describe the state of the playback device 200. The memory 206may also include the data associated with the state of the other devicesof the media system, and shared from time to time among the devices sothat one or more of the devices have the most recent data associatedwith the system. Other embodiments are also possible.

The audio processing components 208 may include one or moredigital-to-analog converters (DAC), an audio preprocessing component, anaudio enhancement component or a digital signal processor (DSP), and soon. In one embodiment, one or more of the audio processing components208 may be a subcomponent of the processor 202. In one example, audiocontent may be processed and/or intentionally altered by the audioprocessing components 208 to produce audio signals. The produced audiosignals may then be provided to the audio amplifier(s) 210 foramplification and playback through speaker(s) 212. Particularly, theaudio amplifier(s) 210 may include devices configured to amplify audiosignals to a level for driving one or more of the speakers 212. Thespeaker(s) 212 may include an individual transducer (e.g., a “driver”)or a complete speaker system involving an enclosure with one or moredrivers. A particular driver of the speaker(s) 212 may include, forexample, a subwoofer (e.g., for low frequencies), a mid-range driver(e.g., for middle frequencies), and/or a tweeter (e.g., for highfrequencies). In some cases, each transducer in the one or more speakers212 may be driven by an individual corresponding audio amplifier of theaudio amplifier(s) 210. In addition to producing analog signals forplayback by the playback device 200, the audio processing components 208may be configured to process audio content to be sent to one or moreother playback devices for playback.

Audio content to be processed and/or played back by the playback device200 may be received from an external source, such as via an audioline-in input connection (e.g., an auto-detecting 3.5 mm audio line-inconnection) or the network interface 214.

The network interface 214 may be configured to facilitate a data flowbetween the playback device 200 and one or more other devices on a datanetwork. As such, the playback device 200 may be configured to receiveaudio content over the data network from one or more other playbackdevices in communication with the playback device 200, network deviceswithin a local area network, or audio content sources over a wide areanetwork such as the Internet. In one example, the audio content andother signals transmitted and received by the playback device 200 may betransmitted in the form of digital packet data containing an InternetProtocol (IP)-based source address and IP-based destination addresses.In such a case, the network interface 214 may be configured to parse thedigital packet data such that the data destined for the playback device200 is properly received and processed by the playback device 200.

As shown, the network interface 214 may include wireless interface(s)216 and wired interface(s) 218. The wireless interface(s) 216 mayprovide network interface functions for the playback device 200 towirelessly communicate with other devices (e.g., other playbackdevice(s), speaker(s), receiver(s), network device(s), control device(s)within a data network the playback device 200 is associated with) inaccordance with a communication protocol (e.g., any wireless standardincluding IEEE 802.11a, 802.11b, 802.11g, 802.11n, 802.11ac, 802.15, 4Gmobile communication standard, and so on). The wired interface(s) 218may provide network interface functions for the playback device 200 tocommunicate over a wired connection with other devices in accordancewith a communication protocol (e.g., IEEE 802.3). While the networkinterface 214 shown in FIG. 2 includes both wireless interface(s) 216and wired interface(s) 218, the network interface 214 may in someembodiments include only wireless interface(s) or only wiredinterface(s).

The microphone(s) 220 may be arranged to detect sound in the environmentof the playback device 200. For instance, the microphone(s) may bemounted on an exterior wall of a housing of the playback device. Themicrophone(s) may be any type of microphone now known or later developedsuch as a condenser microphone, electret condenser microphone, or adynamic microphone. The microphone(s) may be sensitive to a portion ofthe frequency range of the speaker(s) 220. One or more of the speaker(s)220 may operate in reverse as the microphone(s) 220. In some aspects,the playback device 200 might not have microphone(s) 220.

In one example, the playback device 200 and one other playback devicemay be paired to play two separate audio components of audio content.For instance, playback device 200 may be configured to play a leftchannel audio component, while the other playback device may beconfigured to play a right channel audio component, thereby producing orenhancing a stereo effect of the audio content. The paired playbackdevices (also referred to as “bonded playback devices”) may further playaudio content in synchrony with other playback devices.

In another example, the playback device 200 may be sonicallyconsolidated with one or more other playback devices to form a single,consolidated playback device. A consolidated playback device may beconfigured to process and reproduce sound differently than anunconsolidated playback device or playback devices that are paired,because a consolidated playback device may have additional speakerdrivers through which audio content may be rendered. For instance, ifthe playback device 200 is a playback device designed to render lowfrequency range audio content (i.e. a subwoofer), the playback device200 may be consolidated with a playback device designed to render fullfrequency range audio content. In such a case, the full frequency rangeplayback device, when consolidated with the low frequency playbackdevice 200, may be configured to render only the mid and high frequencycomponents of audio content, while the low frequency range playbackdevice 200 renders the low frequency component of the audio content. Theconsolidated playback device may further be paired with a singleplayback device or yet another consolidated playback device.

By way of illustration, SONOS, Inc. presently offers (or has offered)for sale certain playback devices including a “PLAY:1,” “PLAY:3,”“PLAY:5,” “PLAYBAR,” “CONNECT:AMP,” “CONNECT,” and “SUB.” Any otherpast, present, and/or future playback devices may additionally oralternatively be used to implement the playback devices of exampleembodiments disclosed herein. Additionally, it is understood that aplayback device is not limited to the example illustrated in FIG. 2 orto the SONOS product offerings. For example, a playback device mayinclude a wired or wireless headphone. In another example, a playbackdevice may include or interact with a docking station for personalmobile media playback devices. In yet another example, a playback devicemay be integral to another device or component such as a television, alighting fixture, or some other device for indoor or outdoor use.

b. Example Playback Zone Configurations

Referring back to the media playback system 100 of FIG. 1, theenvironment may have one or more playback zones, each with one or moreplayback devices. The media playback system 100 may be established withone or more playback zones, after which one or more zones may be added,or removed to arrive at the example configuration shown in FIG. 1. Eachzone may be given a name according to a different room or space such asan office, bathroom, master bedroom, bedroom, kitchen, dining room,living room, and/or balcony. In one case, a single playback zone mayinclude multiple rooms or spaces. In another case, a single room orspace may include multiple playback zones.

As shown in FIG. 1, the balcony, dining room, kitchen, bathroom, office,and bedroom zones each have one playback device, while the living roomand master bedroom zones each have multiple playback devices. In theliving room zone, playback devices 104, 106, 108, and 110 may beconfigured to play audio content in synchrony as individual playbackdevices, as one or more bonded playback devices, as one or moreconsolidated playback devices, or any combination thereof. Similarly, inthe case of the master bedroom, playback devices 122 and 124 may beconfigured to play audio content in synchrony as individual playbackdevices, as a bonded playback device, or as a consolidated playbackdevice.

In one example, one or more playback zones in the environment of FIG. 1may each be playing different audio content. For instance, the user maybe grilling in the balcony zone and listening to hip hop music beingplayed by the playback device 102 while another user may be preparingfood in the kitchen zone and listening to classical music being playedby the playback device 114. In another example, a playback zone may playthe same audio content in synchrony with another playback zone. Forinstance, the user may be in the office zone where the playback device118 is playing the same rock music that is being playing by playbackdevice 102 in the balcony zone. In such a case, playback devices 102 and118 may be playing the rock music in synchrony such that the user mayseamlessly (or at least substantially seamlessly) enjoy the audiocontent that is being played out-loud while moving between differentplayback zones. Synchronization among playback zones may be achieved ina manner similar to that of synchronization among playback devices, asdescribed in previously referenced U.S. Pat. No. 8,234,395.

As suggested above, the zone configurations of the media playback system100 may be dynamically modified, and in some embodiments, the mediaplayback system 100 supports numerous configurations. For instance, if auser physically moves one or more playback devices to or from a zone,the media playback system 100 may be reconfigured to accommodate thechange(s). For instance, if the user physically moves the playbackdevice 102 from the balcony zone to the office zone, the office zone maynow include both the playback device 118 and the playback device 102.The playback device 102 may be paired or grouped with the office zoneand/or renamed if so desired via a control device such as the controldevices 126 and 128. On the other hand, if the one or more playbackdevices are moved to a particular area in the home environment that isnot already a playback zone, a new playback zone may be created for theparticular area.

Further, different playback zones of the media playback system 100 maybe dynamically combined into zone groups or split up into individualplayback zones. For instance, the dining room zone and the kitchen zone114 may be combined into a zone group for a dinner party such thatplayback devices 112 and 114 may render audio content in synchrony. Onthe other hand, the living room zone may be split into a television zoneincluding playback device 104, and a listening zone including playbackdevices 106, 108, and 110, if the user wishes to listen to music in theliving room space while another user wishes to watch television.

c. Example Control Devices

FIG. 3 shows a functional block diagram of an example control device 300that may be configured to be one or both of the control devices 126 and128 of the media playback system 100. As shown, the control device 300may include a processor 302, memory 304, a network interface 306, a userinterface 308, microphone(s) 310, and software components 312. In oneexample, the control device 300 may be a dedicated controller for themedia playback system 100. In another example, the control device 300may be a network device on which media playback system controllerapplication software may be installed, such as for example, an iPhone™,iPad™ or any other smart phone, tablet or network device (e.g., anetworked computer such as a PC or Mac™).

The processor 302 may be configured to perform functions relevant tofacilitating user access, control, and configuration of the mediaplayback system 100. The memory 304 may be data storage that can beloaded with one or more of the software components executable by theprocessor 302 to perform those functions. The memory 304 may also beconfigured to store the media playback system controller applicationsoftware and other data associated with the media playback system 100and the user.

In one example, the network interface 306 may be based on an industrystandard (e.g., infrared, radio, wired standards including IEEE 802.3,wireless standards including IEEE 802.11a, 802.11b, 802.11g, 802.11n,802.11ac, 802.15, 4G mobile communication standard, and so on). Thenetwork interface 306 may provide a means for the control device 300 tocommunicate with other devices in the media playback system 100. In oneexample, data and information (e.g., such as a state variable) may becommunicated between control device 300 and other devices via thenetwork interface 306. For instance, playback zone and zone groupconfigurations in the media playback system 100 may be received by thecontrol device 300 from a playback device or another network device, ortransmitted by the control device 300 to another playback device ornetwork device via the network interface 306. In some cases, the othernetwork device may be another control device.

Playback device control commands such as volume control and audioplayback control may also be communicated from the control device 300 toa playback device via the network interface 306. As suggested above,changes to configurations of the media playback system 100 may also beperformed by a user using the control device 300. The configurationchanges may include adding/removing one or more playback devices to/froma zone, adding/removing one or more zones to/from a zone group, forminga bonded or consolidated player, separating one or more playback devicesfrom a bonded or consolidated player, among others. Accordingly, thecontrol device 300 may sometimes be referred to as a controller, whetherthe control device 300 is a dedicated controller or a network device onwhich media playback system controller application software isinstalled.

Control device 300 may include microphone(s) 310. Microphone(s) 310 maybe arranged to detect sound in the environment of the control device300. Microphone(s) 310 may be any type of microphone now known or laterdeveloped such as a condenser microphone, electret condenser microphone,or a dynamic microphone. The microphone(s) may be sensitive to a portionof a frequency range. Two or more microphones 310 may be arranged tocapture location information of an audio source (e.g., voice, audiblesound) and/or to assist in filtering background noise.

The user interface 308 of the control device 300 may be configured tofacilitate user access and control of the media playback system 100, byproviding a controller interface such as the controller interface 400shown in FIG. 4. The controller interface 400 includes a playbackcontrol region 410, a playback zone region 420, a playback status region430, a playback queue region 440, and an audio content sources region450. The user interface 400 as shown is just one example of a userinterface that may be provided on a network device such as the controldevice 300 of FIG. 3 (and/or the control devices 126 and 128 of FIG. 1)and accessed by users to control a media playback system such as themedia playback system 100. Other user interfaces of varying formats,styles, and interactive sequences may alternatively be implemented onone or more network devices to provide comparable control access to amedia playback system.

The playback control region 410 may include selectable (e.g., by way oftouch or by using a cursor) icons to cause playback devices in aselected playback zone or zone group to play or pause, fast forward,rewind, skip to next, skip to previous, enter/exit shuffle mode,enter/exit repeat mode, enter/exit cross fade mode. The playback controlregion 410 may also include selectable icons to modify equalizationsettings, and playback volume, among other possibilities.

The playback zone region 420 may include representations of playbackzones within the media playback system 100. In some embodiments, thegraphical representations of playback zones may be selectable to bringup additional selectable icons to manage or configure the playback zonesin the media playback system, such as a creation of bonded zones,creation of zone groups, separation of zone groups, and renaming of zonegroups, among other possibilities.

For example, as shown, a “group” icon may be provided within each of thegraphical representations of playback zones. The “group” icon providedwithin a graphical representation of a particular zone may be selectableto bring up options to select one or more other zones in the mediaplayback system to be grouped with the particular zone. Once grouped,playback devices in the zones that have been grouped with the particularzone will be configured to play audio content in synchrony with theplayback device(s) in the particular zone. Analogously, a “group” iconmay be provided within a graphical representation of a zone group. Inthis case, the “group” icon may be selectable to bring up options todeselect one or more zones in the zone group to be removed from the zonegroup. Other interactions and implementations for grouping andungrouping zones via a user interface such as the user interface 400 arealso possible. The representations of playback zones in the playbackzone region 420 may be dynamically updated as playback zone or zonegroup configurations are modified.

The playback status region 430 may include graphical representations ofaudio content that is presently being played, previously played, orscheduled to play next in the selected playback zone or zone group. Theselected playback zone or zone group may be visually distinguished onthe user interface, such as within the playback zone region 420 and/orthe playback status region 430. The graphical representations mayinclude track title, artist name, album name, album year, track length,and other relevant information that may be useful for the user to knowwhen controlling the media playback system via the user interface 400.

The playback queue region 440 may include graphical representations ofaudio content in a playback queue associated with the selected playbackzone or zone group. In some embodiments, each playback zone or zonegroup may be associated with a playback queue containing informationcorresponding to zero or more audio items for playback by the playbackzone or zone group. For instance, each audio item in the playback queuemay comprise a uniform resource identifier (URI), a uniform resourcelocator (URL) or some other identifier that may be used by a playbackdevice in the playback zone or zone group to find and/or retrieve theaudio item from a local audio content source or a networked audiocontent source, possibly for playback by the playback device.

In one example, a playlist may be added to a playback queue, in whichcase information corresponding to each audio item in the playlist may beadded to the playback queue. In another example, audio items in aplayback queue may be saved as a playlist. In a further example, aplayback queue may be empty, or populated but “not in use” when theplayback zone or zone group is playing continuously streaming audiocontent, such as Internet radio that may continue to play untilotherwise stopped, rather than discrete audio items that have playbackdurations. In an alternative embodiment, a playback queue can includeInternet radio and/or other streaming audio content items and be “inuse” when the playback zone or zone group is playing those items. Otherexamples are also possible.

When playback zones or zone groups are “grouped” or “ungrouped,”playback queues associated with the affected playback zones or zonegroups may be cleared or re-associated. For example, if a first playbackzone including a first playback queue is grouped with a second playbackzone including a second playback queue, the established zone group mayhave an associated playback queue that is initially empty, that containsaudio items from the first playback queue (such as if the secondplayback zone was added to the first playback zone), that contains audioitems from the second playback queue (such as if the first playback zonewas added to the second playback zone), or a combination of audio itemsfrom both the first and second playback queues. Subsequently, if theestablished zone group is ungrouped, the resulting first playback zonemay be re-associated with the previous first playback queue, or beassociated with a new playback queue that is empty or contains audioitems from the playback queue associated with the established zone groupbefore the established zone group was ungrouped. Similarly, theresulting second playback zone may be re-associated with the previoussecond playback queue, or be associated with a new playback queue thatis empty, or contains audio items from the playback queue associatedwith the established zone group before the established zone group wasungrouped. Other examples are also possible.

Referring back to the user interface 400 of FIG. 4, the graphicalrepresentations of audio content in the playback queue region 440 mayinclude track titles, artist names, track lengths, and other relevantinformation associated with the audio content in the playback queue. Inone example, graphical representations of audio content may beselectable to bring up additional selectable icons to manage and/ormanipulate the playback queue and/or audio content represented in theplayback queue. For instance, a represented audio content may be removedfrom the playback queue, moved to a different position within theplayback queue, or selected to be played immediately, or after anycurrently playing audio content, among other possibilities. A playbackqueue associated with a playback zone or zone group may be stored in amemory on one or more playback devices in the playback zone or zonegroup, on a playback device that is not in the playback zone or zonegroup, and/or some other designated device.

The audio content sources region 450 may include graphicalrepresentations of selectable audio content sources from which audiocontent may be retrieved and played by the selected playback zone orzone group. Discussions pertaining to audio content sources may be foundin the following section.

d. Example Audio Content Sources

As indicated previously, one or more playback devices in a zone or zonegroup may be configured to retrieve for playback audio content (e.g.according to a corresponding URI or URL for the audio content) from avariety of available audio content sources. In one example, audiocontent may be retrieved by a playback device directly from acorresponding audio content source (e.g., a line-in connection). Inanother example, audio content may be provided to a playback device overa network via one or more other playback devices or network devices.

Example audio content sources may include a memory of one or moreplayback devices in a media playback system such as the media playbacksystem 100 of FIG. 1, local music libraries on one or more networkdevices (such as a control device, a network-enabled personal computer,or a networked-attached storage (NAS), for example), streaming audioservices providing audio content via the Internet (e.g., the cloud), oraudio sources connected to the media playback system via a line-in inputconnection on a playback device or network devise, among otherpossibilities.

In some embodiments, audio content sources may be regularly added orremoved from a media playback system such as the media playback system100 of FIG. 1. In one example, an indexing of audio items may beperformed whenever one or more audio content sources are added, removedor updated. Indexing of audio items may involve scanning foridentifiable audio items in all folders/directory shared over a networkaccessible by playback devices in the media playback system, andgenerating or updating an audio content database containing metadata(e.g., title, artist, album, track length, among others) and otherassociated information, such as a URI or URL for each identifiable audioitem found. Other examples for managing and maintaining audio contentsources may also be possible.

The above discussions relating to playback devices, controller devices,playback zone configurations, and media content sources provide onlysome examples of operating environments within which functions andmethods described below may be implemented. Other operating environmentsand configurations of media playback systems, playback devices, andnetwork devices not explicitly described herein may also be applicableand suitable for implementation of the functions and methods.

e. Example Plurality of Networked Devices

FIG. 5 shows an example plurality of devices 500 that may be configuredto provide an audio playback experience based on voice control. Onehaving ordinary skill in the art will appreciate that the devices shownin FIG. 5 are for illustrative purposes only, and variations includingdifferent and/or additional devices may be possible. As shown, theplurality of devices 500 includes computing devices 504, 506, and 508;network microphone devices (NMDs) 512, 514, and 516; playback devices(PBDs) 532, 534, 536, and 538; and a controller device (CR) 522.

Each of the plurality of devices 500 may be network-capable devices thatcan establish communication with one or more other devices in theplurality of devices according to one or more network protocols, such asNFC, Bluetooth, Ethernet, and IEEE 802.11, among other examples, overone or more types of networks, such as wide area networks (WAN), localarea networks (LAN), and personal area networks (PAN), among otherpossibilities.

As shown, the computing devices 504, 506, and 508 may be part of a cloudnetwork 502. The cloud network 502 may include additional computingdevices. In one example, the computing devices 504, 506, and 508 may bedifferent servers. In another example, two or more of the computingdevices 504, 506, and 508 may be modules of a single server.Analogously, each of the computing device 504, 506, and 508 may includeone or more modules or servers. For ease of illustration purposesherein, each of the computing devices 504, 506, and 508 may beconfigured to perform particular functions within the cloud network 502.For instance, computing device 508 may be a source of audio content fora streaming music service.

As shown, the computing device 504 may be configured to interface withNMDs 512, 514, and 516 via communication path 542. NMDs 512, 514, and516 may be components of one or more “Smart Home” systems. In one case,NMDs 512, 514, and 516 may be physically distributed throughout ahousehold, similar to the distribution of devices shown in FIG. 1. Inanother case, two or more of the NMDs 512, 514, and 516 may bephysically positioned within relative close proximity of one another.Communication path 542 may comprise one or more types of networks, suchas a WAN including the Internet, LAN, and/or PAN, among otherpossibilities.

In one example, one or more of the NMDs 512, 514, and 516 may be devicesconfigured primarily for audio detection. In another example, one ormore of the NMDs 512, 514, and 516 may be components of devices havingvarious primary utilities. For instance, as discussed above inconnection to FIGS. 2 and 3, one or more of NMDs 512, 514, and 516 maybe the microphone(s) 220 of playback device 200 or the microphone(s) 310of network device 300. Further, in some cases, one or more of NMDs 512,514, and 516 may be the playback device 200 or network device 300. In anexample, one or more of NMDs 512, 514, and/or 516 may include multiplemicrophones arranged in a microphone array.

As shown, the computing device 506 may be configured to interface withCR 522 and PBDs 532, 534, 536, and 538 via communication path 544. Inone example, CR 522 may be a network device such as the network device200 of FIG. 2. Accordingly, CR 522 may be configured to provide thecontroller interface 400 of FIG. 4. Similarly, PBDs 532, 534, 536, and538 may be playback devices such as the playback device 300 of FIG. 3.As such, PBDs 532, 534, 536, and 538 may be physically distributedthroughout a household as shown in FIG. 1. For illustration purposes,PBDs 536 and 538 may be part of a bonded zone 530, while PBDs 532 and534 may be part of their own respective zones. As described above, thePBDs 532, 534, 536, and 538 may be dynamically bonded, grouped,unbonded, and ungrouped. Communication path 544 may comprise one or moretypes of networks, such as a WAN including the Internet, LAN, and/orPAN, among other possibilities.

In one example, as with NMDs 512, 514, and 516, CR 522 and PBDs 532,534, 536, and 538 may also be components of one or more “Smart Home”systems. In one case, PBDs 532, 534, 536, and 538 may be distributedthroughout the same household as the NMDs 512, 514, and 516. Further, assuggested above, one or more of PBDs 532, 534, 536, and 538 may be oneor more of NMDs 512, 514, and 516.

The NMDs 512, 514, and 516 may be part of a local area network, and thecommunication path 542 may include an access point that links the localarea network of the NMDs 512, 514, and 516 to the computing device 504over a WAN (communication path not shown). Likewise, each of the NMDs512, 514, and 516 may communicate with each other via such an accesspoint.

Similarly, CR 522 and PBDs 532, 534, 536, and 538 may be part of a localarea network and/or a local playback network as discussed in previoussections, and the communication path 544 may include an access pointthat links the local area network and/or local playback network of CR522 and PBDs 532, 534, 536, and 538 to the computing device 506 over aWAN. As such, each of the CR 522 and PBDs 532, 534, 536, and 538 mayalso communicate with each over such an access point.

In one example, communication paths 542 and 544 may comprise the sameaccess point. In an example, each of the NMDs 512, 514, and 516, CR 522,and PBDs 532, 534, 536, and 538 may access the cloud network 502 via thesame access point for a household.

As shown in FIG. 5, each of the NMDs 512, 514, and 516, CR 522, and PBDs532, 534, 536, and 538 may also directly communicate with one or more ofthe other devices via communication means 546. Communication means 546as described herein may involve one or more forms of communicationbetween the devices, according to one or more network protocols, overone or more types of networks, and/or may involve communication via oneor more other network devices. For instance, communication means 546 mayinclude one or more of for example, Bluetooth™ (IEEE 802.15), NFC,Wireless direct, and/or Proprietary wireless, among other possibilities.

In one example, CR 522 may communicate with NMD 512 over Bluetooth™, andcommunicate with PBD 534 over another local area network. In anotherexample, NMD 514 may communicate with CR 522 over another local areanetwork, and communicate with PBD 536 over Bluetooth. In a furtherexample, each of the PBDs 532, 534, 536, and 538 may communicate witheach other according to a spanning tree protocol over a local playbacknetwork, while each communicating with CR 522 over a local area network,different from the local playback network. Other examples are alsopossible.

In some cases, communication means between the NMDs 512, 514, and 516,CR 522, and PBDs 532, 534, 536, and 538 may change depending on types ofcommunication between the devices, network conditions, and/or latencydemands. For instance, communication means 546 may be used when NMD 516is first introduced to the household with the PBDs 532, 534, 536, and538. In one case, the NMD 516 may transmit identification informationcorresponding to the NMD 516 to PBD 538 via NFC, and PBD 538 may inresponse, transmit local area network information to NMD 516 via NFC (orsome other form of communication). However, once NMD 516 has beenconfigured within the household, communication means between NMD 516 andPBD 538 may change. For instance, NMD 516 may subsequently communicatewith PBD 538 via communication path 542, the cloud network 502, andcommunication path 544. In another example, the NMDs and PBDs may nevercommunicate via local communications means 546. In a further example,the NMDs and PBDs may communicate primarily via local communicationsmeans 546. Other examples are also possible.

In an illustrative example, NMDs 512, 514, and 516 may be configured toreceive voice inputs to control PBDs 532, 534, 536, and 538. Theavailable control commands may include any media playback systemcontrols previously discussed, such as playback volume control, playbacktransport controls, music source selection, and grouping, among otherpossibilities. In one instance, NMD 512 may receive a voice input tocontrol one or more of the PBDs 532, 534, 536, and 538. In response toreceiving the voice input, NMD 512 may transmit via communication path542, the voice input to computing device 504 for processing. In oneexample, the computing device 504 may convert the voice input to anequivalent text command, and parse the text command to identify acommand. Computing device 504 may then subsequently transmit the textcommand to the computing device 506. In another example, the computingdevice 504 may convert the voice input to an equivalent text command,and then subsequently transmit the text command to the computing device506. The computing device 506 may then parse the text command toidentify one or more playback commands.

For instance, if the text command is “Play ‘Track 1’ by ‘Artist 1’ from‘Streaming Service 1’ in ‘Zone 1’,” The computing device 506 mayidentify (i) a URL for “Track 1” by “Artist 1” available from “StreamingService 1,” and (ii) at least one playback device in “Zone 1.” In thisexample, the URL for “Track 1” by “Artist 1” from “Streaming Service 1”may be a URL pointing to computing device 508, and “Zone 1” may be thebonded zone 530. As such, upon identifying the URL and one or both ofPBDs 536 and 538, the computing device 506 may transmit viacommunication path 544 to one or both of PBDs 536 and 538, theidentified URL for playback. One or both of PBDs 536 and 538 mayresponsively retrieve audio content from the computing device 508according to the received URL, and begin playing “Track 1” by “Artist 1”from “Streaming Service 1.”

One having ordinary skill in the art will appreciate that the above isjust one illustrative example, and that other implementations are alsopossible. In one case, operations performed by one or more of theplurality of devices 500, as described above, may be performed by one ormore other devices in the plurality of device 500. For instance, theconversion from voice input to the text command may be alternatively,partially, or wholly performed by another device or devices, such as NMD512, computing device 506, PBD 536, and/or PBD 538. Analogously, theidentification of the URL may be alternatively, partially, or whollyperformed by another device or devices, such as NMD 512, computingdevice 504, PBD 536, and/or PBD 538.

f. Example Network Microphone Device

FIG. 6 shows a function block diagram of an example network microphonedevice 600 that may be configured to be one or more of NMDs 512, 514,and 516 of FIG. 5. As shown, the network microphone device 600 includesa processor 602, memory 604, a microphone array 606, a network interface608, a user interface 610, software components 612, and speaker(s) 614.One having ordinary skill in the art will appreciate that other networkmicrophone device configurations and arrangements are also possible. Forinstance, network microphone devices may alternatively exclude thespeaker(s) 614 or have a single microphone instead of microphone array606.

The processor 602 may include one or more processors and/or controllers,which may take the form of a general or special-purpose processor orcontroller. For instance, the processing unit 602 may includemicroprocessors, microcontrollers, application-specific integratedcircuits, digital signal processors, and the like. The memory 604 may bedata storage that can be loaded with one or more of the softwarecomponents executable by the processor 602 to perform those functions.Accordingly, memory 604 may comprise one or more non-transitorycomputer-readable storage mediums, examples of which may includevolatile storage mediums such as random access memory, registers, cache,etc. and non-volatile storage mediums such as read-only memory, ahard-disk drive, a solid-state drive, flash memory, and/or anoptical-storage device, among other possibilities.

The microphone array 606 may be a plurality of microphones arranged todetect sound in the environment of the network microphone device 600.Microphone array 606 may include any type of microphone now known orlater developed such as a condenser microphone, electret condensermicrophone, or a dynamic microphone, among other possibilities. In oneexample, the microphone array may be arranged to detect audio from oneor more directions relative to the network microphone device. Themicrophone array 606 may be sensitive to a portion of a frequency range.In one example, a first subset of the microphone array 606 may besensitive to a first frequency range, while a second subset of themicrophone array may be sensitive to a second frequency range. Themicrophone array 606 may further be arranged to capture locationinformation of an audio source (e.g., voice, audible sound) and/or toassist in filtering background noise. Notably, in some embodiments themicrophone array may consist of only a single microphone, rather than aplurality of microphones.

The network interface 608 may be configured to facilitate wirelessand/or wired communication between various network devices, such as, inreference to FIG. 5, CR 522, PBDs 532-538, computing device 504-508 incloud network 502, and other network microphone devices, among otherpossibilities. As such, network interface 608 may take any suitable formfor carrying out these functions, examples of which may include anEthernet interface, a serial bus interface (e.g., FireWire, USB 2.0,etc.), a chipset and antenna adapted to facilitate wirelesscommunication, and/or any other interface that provides for wired and/orwireless communication. In one example, the network interface 608 may bebased on an industry standard (e.g., infrared, radio, wired standardsincluding IEEE 802.3, wireless standards including IEEE 802.11a,802.11b, 802.11g, 802.11n, 802.11ac, 802.15, 4G mobile communicationstandard, and so on).

The user interface 610 of the network microphone device 600 may beconfigured to facilitate user interactions with the network microphonedevice. In one example, the user interface 608 may include one or moreof physical buttons, graphical interfaces provided on touch sensitivescreen(s) and/or surface(s), among other possibilities, for a user todirectly provide input to the network microphone device 600. The userinterface 610 may further include one or more of lights and thespeaker(s) 614 to provide visual and/or audio feedback to a user. In oneexample, the network microphone device 600 may further be configured toplayback audio content via the speaker(s) 614.

III. Example Systems and Methods

To execute a voice command to control the media playback system, it isdesirable in some instances for the media playback system to receive avoice command and determine an appropriate action for the media playbacksystem to execute based on user identification (or at least based on theuser who spoke the voice command). In some embodiments, the mediaplayback system includes one or more of PBDs 532, 534, 536, and 538 andcomputing device 506 (which is configured as a media playback systemserver). In some embodiments, the media playback system may include orcommunicate with a networked microphone system that includes one or moreof NMDs 512, 514, and 516 and computing device 504 (which is configuredas a networked microphone system server).

Generally, it should be understood that one or more functions describedherein may be performed by the networked microphone system individuallyor in combination with the media playback system. It should be furtherunderstood that one or more functions performed by the computing device506 may be performed by CR 522 and/or one or more of PBDs 532, 534, 536,and 538 of the media playback system.

Examples of voice commands include commands to control any of the mediaplayback system controls discussed previously. For example, in someembodiments, the voice command may be a command for the media playbacksystem to play media content via one or more playback devices of themedia playback system. In some embodiments, the voice command may be acommand to trigger a time period or window in which to receiveadditional voice commands associated with the initial voice command. Insome embodiments, the voice command may be a command to modify aplayback setting for one or more media playback devices of the mediaplayback system. Playback settings may include, for example, playbackvolume, playback transport controls, music source selection, andgrouping, among other possibilities.

Examples of media content include, talk radio, books, audio fromtelevision, music stored on a local drive, or music from media sources,among others. Examples of media sources include Pandora® Radio,Spotify®, Slacker®, Radio, Google Play™, and iTunes Radio, among others.

Examples of user identification include identifying a user as aregistered user, a guest user, a child, or an unknown user.

Example registered users include one or more users linked or associatedwith the media playback system by a user profile, and/or voiceconfiguration settings, among other possibilities. Example user profilesmay include information about a user's age, location, preferred playbacksettings, preferred playlists, preferred audio content, accessrestrictions set on the user, and information identifying the user'svoice, user history, among other possibilities. Example informationidentifying the user's voice includes the tone or frequency of a user'svoice, age, gender, and user history, among other information. Examplevoice configuration settings may include settings that ask a user toprovide voice inputs or a series of voice inputs for the media playbacksystem to recognize and associate the user with.

Example guest users include one or more users linked or associated withthe media playback system by a registered user's user profile, or aguest profile created by a registered user or a guest user with theregistered user's permission. Example guest profiles may include anytype of information included in a user profile.

In some embodiments, a guest with his or her own media playback systemin his or her own house may have a user profile associated with his orher own media playback system stored in computing device 506, forexample. In operation, when that guest arrives at the host's home andtries to use voice commands to control the host's media playback system,the computing device 506 connected to the host's playback system may beable to access user profile settings of the guest, including but notlimited to (i) music services that the guest has user accounts with,(ii) the guest's playlists, (iii) whether the host has granted the guestaccess to control the host's media playback system, and/or (iv) perhapsother user information in the guest's user profile.

A child user may be identified by, for example, information in a userprofile if the child is one of the registered users of the mediaplayback system, information in a guest profile, and/or the tone orfrequency of the user's voice.

In some embodiments, receiving a voice command includes the mediaplayback system receiving a voice command via one or more of PBDs 532,534, 536, and 538 and/or computing device 506 (which is configured as amedia playback system server). In one example, computing device 506 mayconvert the voice command to an equivalent text command, and parse thetext command to identify a command.

In some embodiments, one or more functions may be performed by thenetworked microphone system individually or in combination with themedia playback system. In some embodiments, receiving a voice commandincludes the networked microphone system receiving a voice command viaone or more of NMDs 512, 514, or 516, and transmitting the voice commandto the computing device 506 and/or one or more of PBDs 532, 534, 536,and 538 for further processing. In some embodiments, the computingdevice 506 may convert the voice command to an equivalent text command,and parse the text command to identify a command. In some embodiments,the networked microphone system may convert the voice command to anequivalent text command and transmit the text command to the computingdevice 506 and/or one or more of PBDs 532, 534, 536, and 538 to parsethe text command and identify a command.

After receiving a voice command, the computing device 506 and/or one ormore of PBDs 532, 534, 536, and 538 determines whether the voice commandwas received from a registered user of the media playback system. Insome embodiments, determining whether the voice command was receivedfrom a registered user may include the computing device 506 and/or oneor more of PBDs 532, 534, 536, and 538 determining whether there is auser profile stored on the media playback system that is associated withthe voice command. For example, the computing device 506 and/or one ormore of PBDs 532, 534, 536, and 538 may try to match the voice commandto information identifying a user's voice that may be included in a userprofile stored on the media playback system. In some embodiments, thenetworked microphone system individually or in combination with themedia playback system may determine whether the voice command wasreceived from a registered user of the media playback system bycommunicating with computing device 506.

In some embodiments, determining whether the voice command was receivedfrom a registered user may include the computing device 506 and/or oneor more of PBDs 532, 534, 536, and 538 determining whether the voicecommand matches the voice inputs in the media playback system's voiceconfiguration settings. For example, a user may have previouslyconfigured the media playback system to recognize the user's voice byproviding a voice input or a series of voice inputs for the mediaplayback system to recognize and associate the user with. The voiceinput or series of voice inputs may be stored on the computing device506 and/or one or more of PBDs 532, 534, 536, and 538. In someembodiments, the voice input or series of voice inputs may be stored onthe networked microphone system.

In some embodiments, determining whether the voice command was receivedfrom a registered user may include the computing device 506, CR 522,and/or one or more of PBDs 532, 534, 536, and 538, individually or incombination, determining a confidence level associated with a voicecommand received. A confidence level may be determined based on userhistory, location, individually or in combination with any otherinformation generally found in a user profile.

For example, the media playback system, may receive a first voicecommand from a registered user in the kitchen and determine a confidencelevel based on the voice command received. The media playback system mayreceive the first voice command from any one or more of NMDs 512-513, CR522, and PBDs 532-538. Further, the media playback system may receivethe same voice command from the registered user in another room in theuser's house and determine a confidence level based on the voice commandreceived. The media playback system may receive the second voice commandfrom any one or more of NMDs 512-513, CR 522, and PBDs 532-538. Themedia playback system may then determine a new confidence level based onthe received commands from different computing devices (e.g., CR 522),NMDs, and/or PBDs throughout the user's house. As a result, the mediaplayback system may have a greater confidence level that the voicecommand was received from a registered user.

In another example, the media playback system may receive a voicecommand from a registered user and determine a confidence level based onuser history. In operation, the media playback system may receive thevoice command from any one or more of NMDs 512-513, CR 522, and PBDs532-538. After receiving the voice command, computing device 506, CR522, and/or one or more of PBDs 532, 534, 536, and 538, individually orin combination, may determine a higher confidence level if the voicecommand received includes an artist, playlist, genre, or any otherinformation found in a user profile that is typically associated withthe registered user. For example, if a registered user typically listensto songs by Michael Jackson, the media playback system may have agreater confidence level that a voice command to play “Thriller” byMichael Jackson was received from a registered user. Many otherexamples, similar and different from the above, are possible.

In some embodiments, the media playback system may build a confidencelevel based on a registered user's pattern of voice commands found in auser's profile. For example, the media playback system may receive avoice command from a registered user to play a particular song byBritney Spears, and determine a confidence level based on the receivedvoice command. Every time the media playback system receives the samevoice command or similar voice command, such as a command to playanother song by Britney Spears, the media playback system may build ahigher confidence level and thus, may have a greater confidence levelthat the voice command was received from a registered user.

Generally, as mentioned previously, it should be understood that one ormore functions described herein may be performed by the networkedmicrophone system individually or in combination with the media playbacksystem. It should be further understood that one or more functionsperformed by the computing device 506 may be performed by CR 522 and/orone or more of PBDs 532, 534, 536, and 538 of the media playback systemand/or perhaps one or more of NMDs 512, 514, and 516.

In some embodiments, determining a confidence level includes the mediaplayback system determining a confidence level via computing device 506(which is configured as a media playback system server), CR 522, and/orone or more of PBDs 532, 534, 536, and 538, individually or incombination with one another. For example, CR 522, and/or one or more ofPBDs 532, 534, 536, and 538 may (i) determine a confidence levelassociated with a received voice command, (ii) determine that the voicecommand was received from a registered user based on the determinedconfidence level, and (iii) send an instruction to computing device 506(which is configured as a media playback system server) to execute thevoice command. In another example, CR 522, and/or one or more of PBDs532, 534, 536, and 538 may (i) determine a confidence level associatedwith a received voice command, and (ii) send data associated with theconfidence level to computing device 506 for further processing.Computing device 506 may then (i) determine that the voice command wasreceived from a registered user based on the determined confidencelevel, and (ii) send an instruction to execute the voice command to CR522, and/or one or more of PBDs 532, 534, 536, and 538.

In some embodiments, determining a confidence level includes the mediaplayback system determining a confidence level individually or incombination with the networked microphone system. For example, the mediaplayback system may receive a voice command via CR 522 and/or one ormore of PBDs 532, 534, 536, and 538 of the media playback system and/orperhaps one or more of NMDs 512, 514, and 516. In response to thereceived voice command, the media playback system may send dataassociated with a confidence level to one or more of NMDs 512, 514, or516. The networked microphone may then (i) determine a confidence levelassociated with the received data, and (ii) execute a command or send aninstruction to the media playback system to execute a command. Inresponse to determining that the voice command was received from aregistered user, the computing device 506 may configure an instructionor a set of instructions for one or more PBDs of the media playbacksystem. The instructions may be based on content from the voice commandand information in a user profile for the registered user. Additionallyor alternatively, the instructions may be based on content from thevoice command and voice configuration settings stored on the computingdevice 506, one or more of PBDs 532, 534, 536, and 538, or the networkedmicrophone system.

In some embodiments, the content from the voice command may include acommand for one or more PBDs of the media playback system to play mediacontent. In some embodiments, based on the command for the mediaplayback system to play media content and information in a user profilefor the registered user, computing device 506 may configure aninstruction or a set of instructions to cause one or more of PBDs toobtain media content from a preferred media source of a registered user.

In some embodiments, based on the command for the media playback systemto play media content and information in a user profile for theregistered user, computing device 506 may configure an instruction or aset of instructions to cause the media playback system to play the mediacontent via one or more PBDs of the media playback system.

In some embodiments, based on the command for the media playback systemto play media content and information in a user profile for theregistered user, the computing device 506 may include instructions to(i) configure the media playback system with one or more of theregistered user's preferred playback settings and (ii) cause one or morePBDs to play the media content with the registered user's preferredplayback settings. Preferred playback settings may be preferred playbacksettings stored in a registered user's user profile. Additionally oralternatively, preferred playback settings may be based on user historystored in a registered user's user profile. User history may includecommonly used or previously used playback settings by the user to playmedia content.

In some embodiments, the content from the voice command may include acommand for the media playback system to play media content but may notidentify a particular listening zone or playback zone of the mediaplayback system. Based on this content and information in a user profilefor the registered user, such as user history, the computing device 506may (i) configure an instruction or a set of instructions to cause themedia playback system to play the media content via one or more PBDswithin the particular playback zone of the media playback system and(ii) implement the configured instruction or set of instructions to playthe media content via the one or more PBDs.

In some embodiments, the content from the voice command may include acommand for the media playback system to modify a playback setting.Based on the command for the media playback system to modify a playbacksetting and information in a user profile for the registered user, thecomputing device 506 may (i) configure an instruction or a set ofinstructions to cause the media playback system to modify the playbacksetting for one or more PBDs of the media playback system and (ii)implement the configured instruction or set of instructions to modifythe playback setting via the one or more PBDs.

Some embodiments include the media playback system determining whetherthe voice command was received from a child. In some embodiments, thecomputing device 506 may distinguish between an adult and a child basedon information in a user profile if the child is one of the registeredusers of the media playback system. In some embodiments, the computingdevice 506 may distinguish between an adult and a child based on thetone or frequency of the user's voice.

In some embodiments, determining whether the voice command was receivedfrom a child may include the computing device 506, CR 522, and/or one ormore of PBDs 532, 534, 536, and 538 (individually or in combination)determining a confidence level associated with a voice command received.As described above, a confidence level may be determined based on userhistory, location, individually or in combination with any otherinformation generally found in a user profile.

For example, the media playback system may receive a voice command froman NMD or PBD located in a particular room where a child is likely to be(e.g., child's bedroom, playroom, basement, etc). Because the voicecommand was received from a device (an NMD or PBD) located in a roomwhere a child is likely to be, the media playback system may have agreater confidence level that the voice command was received from achild.

In another example, the media playback system, may receive a voicecommand for a particular type of content, and based on the type ofcontent, determine a higher confidence level that the voice command wasreceived from a child. For example, if the media playback systemreceives a voice command to play a song from a cartoon show or movie,the media playback system may have a greater confidence level that thevoice command was received from a child. Many other examples, similarand different from the above, are possible. In response to determiningthat the voice command was received from a child, some embodiments mayprevent one or more PBDs from playing given media that may beinappropriate for the child. Some embodiments may prevent the computingdevice 506 and/or one or more PBDs from modifying a playback settingbased on the content of a child's voice command. For example, thecomputing device 506 and/or one or more PBDs may disregard a child'svoice command to increase the volume of one or more PBDs.

Some embodiments include the media playback device taking actions basedon determining whether a voice command was received from a guest userinstead of a registered user of the media playback system. In someembodiments, computing device 506 may have stored a previously createdguest profile that may be associated with a particular guest. In someembodiments, computing device 506 may determine that a voice command wasnot received from a registered user, and may then ask the registereduser if the voice command came from a guest. The registered user maythen have the option to prevent the computing device 506 and/or one ormore PBDs from executing all or part of the contents of the voicecommand.

In some embodiments, determining whether the voice command was receivedfrom a guest user may include the computing device 506, CR 522, and/orone or more of PBDs 532, 534, 536, and 538 (individually or incombination) determining a confidence level associated with a voicecommand received. As described above, a confidence level may bedetermined based on user history, location, individually or incombination with any other information generally found in a userprofile.

In response to determining that the voice command was received from aguest user, the computing device 506 may (1) assign a restrictionsetting for the guest user, (2) configure an instruction for one or morePBDs based on content from the voice command and the assignedrestriction setting for the guest user, and (3) send the instruction toone or more PBDs for execution. In some embodiments, assigning arestriction setting for a guest user may include the computing device506 matching the voice command to a particular guest profile stored onthe computing device 506 and/or one or more PBDs. The guest profile mayinclude restriction settings, and information regarding the voice of theparticular guest user, such as frequency or tone of the guest's voice,among other information described previously. A restriction setting maybe any setting that limits the control of the media playback system.

Some embodiments include the media playback system determining an orderof preference to resolve conflicting voice commands received fromdifferent users. A conflicting voice commands may be, for example, avoice command received from a user to play a song and a subsequent voicecommand received from another user to stop playing the song. Otherexamples are possible, such as a voice command received from a user toincrease the volume of one or more PBDs 532, 534, 536, and 538, and asubsequent voice command received from another user to decrease thevolume. In particular, the media playback system (via one or more ofNMDs 512-516, CR 522, PBDs 532-538, and/or computing device 506) mayreceive a voice command from a registered user or host to play a song ina playback zone. Subsequently, the media playback system may receive aconflicting voice command from a nonregistered user or guest to stopplaying the song in the playback zone. To resolve this conflict, themedia playback system may apply an order of preference in which voicecommands received from a registered user have a higher priority than anonregistered user or guest.

In some embodiments, the media playback system may assign an order ofpreference in which voice commands received from registered guests havea higher priority than nonregistered guests. In some embodiments, voicecommands received from one registered guest may have a higher prioritythan another registered guest. Additionally or alternatively, voicecommands received from an adult may have a higher priority than a child.

In another embodiment, controller-issued commands (e.g., commands issuedby CR 522 or another computing device configured to control the mediaplayback system) received by the media playback system may have a lowerpriority than a registered user, but may have a higher priority than anonregistered user or guest. In some embodiments, some registered guestsmay have a higher priority than controller-issued commands. Otherexamples of determining and assigning an order of preference arepossible.

Additionally, the media playback system may take actions based onreceiving a wakeup word or wakeup phrase, associated with a registereduser. A wakeup word or phrase may be a specific word or phrase (e.g.,“Hey, Sonos”) stored in a registered user's profile. In someembodiments, different users may configure the media playback system fordifferent wakeup words or phrases. In other embodiments, the mediaplayback system may be configured with the same wakeup word or phrasefor all (or any) users.

In some embodiments, a registered user may have a universal wakeup wordor phrase that triggers a time period or window for the media playbacksystem to receive additional voice commands associated with the wakeupword or phrase from the registered user, a guest, and/or a nonregistereduser. For example, a registered user or host may send a voice command toadd songs to a play queue (e.g., “Hey Sonos, let's queue up songs”),which may open a time period or window (e.g., five minutes) during whichthe registered user can send additional voice commands to add specificsongs to the play queue (e.g., “Add Thriller by Michael Jackson”). Inanother example, a registered user or host may send a voice command(e.g., “Hey Sonos, open control for my house system”) that authorizesall guests in a house to send voice commands to add songs to a playqueue, play songs, or change the volume, among other functions for auser-defined or default time period or window, or for a specific periodof time (e.g., “Hey Sonos, open control for my house system for the next4 hours” or “Hey Sonos, open control for my house system from now untilSaturday at 2 pm”). In some embodiments, a registered user or host maysend a voice command (e.g., “Hey Sonos, restrict control for my livingroom to authorized guests”) that authorizes only some of the guests tosend voice commands for a time period or window to control one or morePBDs 532, 534, 536, and 538 and/or computing device 506 in a playbackzone.

In some embodiments, a registered user may have a different wakeup wordor phrase for different voice commands that triggers a time period orwindow for the media playback system to receive additional voicecommands associated with the wakeup word or phrase. For example, aregistered user or host may have a user-specific wakeup word or phraseto send a voice command to add songs to a play queue (e.g., “Hey Sonos,let's queue up songs” “Yo, Sonos, queue songs,” “Alpha song queue,”etc), and may have a different user-specific wake up word or phrase toauthorize guests in a house to control the media playback device (e.g.,“Hey Sonos, open access,” “It's party time,” etc).

In some embodiments, a registered user or host may have a user-specificor universal wakeup word or phrase to send a voice command to authorizecertain guests in a house to have restricted control of the mediaplayback system for a time period or window. U.S. Patent Pub. No.2013/0346859 entitled, “Systems, Methods, Apparatus, and Articles ofManufacture to Provide a Crowd-Sourced Playlist with Guest Access,”which is hereby incorporated by reference, provides in more detail someexamples for restricted control of the media playback system.

Additionally, a registered user or host may have a user-specific oruniversal wakeup word or phrase to send a voice command to authorizeregistered guests in a house to have open control or restricted controlof the media playback back system for a time period or window, whilepreventing nonregistered guests from having control. In someembodiments, a registered user or host may have a user-specific oruniversal wakeup word or phrase to send a voice command to authorizeadults in a house to have open control or restricted control of themedia playback system for a time period or window, while preventingchildren from having control. Many other examples, similar and differentfrom the above, are possible.

In some embodiments, a registered user or host may specify the timeperiod or window for the media playback system to receive additionalvoice commands. For example, a registered user or host may send a voicecommand (e.g., Hey, Sonos, open control for my house system for onehour”) that authorizes guests to send additional voice commands tocontrol the media playback system for the specified time period (e.g.,one hour). Many other examples, similar and different from the above,are possible.

In some embodiments, a registered user or host may close or key off thetime period or window for receiving additional voice commands associatedwith the initial wakeup word or phrase. For example, if a registereduser or host speaks a voice command with a wake up word or phrase thatopens a time period or window to receive additional voice commands foran hour, the registered user or host may send another voice command(e.g., “Hey Sonos, queue songs complete”) to key off the one hour timeperiod or window before the one hour time period expires. Many otherexamples, similar and different from the above, are possible.

In some embodiments, the media playback system may take actions based onreceiving a wakeup word or wakeup phrase from a registered guest user. Aregistered guest user may have wakeup words or phrases stored in a guestprofile. In response to determining that a wakeup word or wakeup phrasewas received from a guest user, the media playback system may (i)determine whether there is a restriction setting associated with theguest user, (ii) configure an instruction for one or more PBDs based onthe wakeup word or phrase and the assigned restriction setting for theguest user, and (iii) send the instruction to one or more PBDs forexecution (e.g., to open a time period or window to receive additionalvoice commands associated with the wake up word command).

In some embodiments, the media playback system may refrain from takingactions based on receiving a wakeup word or phrase from a registeredguest user if, for example, the media playback system has alreadyreceived a voice command with a wakeup word or phrase from a registereduser or host, and the time period or window to receive additionalcommands has not expired.

In some embodiments, the media playback system may take actions based onreceiving a wakeup word or wakeup phrase from a registered guest userand subsequently close or key off the time period or window forreceiving additional voice commands if the media playback devicesubsequently receives a voice command from a registered user or host. Insome embodiments, the registered guest may close or key off the timeperiod or window before it expires. In other embodiments, an adult mayclose or key off the time period or window before it expires if theregistered guest is a child. Many other examples, similar and differentfrom the above, are possible.

After configuring an instruction or set of instructions for the mediaplayback system, some embodiments may send the instruction or set ofinstructions to one or more PBDs of the media playback system to executethe instructions. In some embodiments, the media playback system maysend the instruction or set of instructions to computing device 506. Insome embodiments, the media playback system may send the instruction orset of instructions to the networked microphone system.

Method 700 shown in FIG. 7 presents an embodiment of a method that canbe implemented within an operating environment including or involving,for example, the media playback system 100 of FIG. 1, one or moreplayback devices 200 of FIG. 2, one or more control devices 300 of FIG.3, the user interface of FIG. 4, and/or the configuration shown in FIG.5. Method 700 may include one or more operations, functions, or actionsas illustrated by one or more of blocks 702-706. Although the blocks areillustrated in sequential order, these blocks may also be performed inparallel, and/or in a different order than those described herein. Also,the various blocks may be combined into fewer blocks, divided intoadditional blocks, and/or removed based upon the desired implementation.

In addition, for the method 700 and other processes and methodsdisclosed herein, the flowchart shows functionality and operation of onepossible implementation of some embodiments. In this regard, each blockmay represent a module, a segment, or a portion of program code, whichincludes one or more instructions executable by a processor forimplementing specific logical functions or steps in the process. Theprogram code may be stored on any type of computer readable medium, forexample, such as a storage device including a disk or hard drive. Thecomputer readable medium may include non-transitory computer readablemedium, for example, such as tangible, non-transitory computer-readablemedia that stores data for short periods of time like register memory,processor cache and Random Access Memory (RAM). The computer readablemedium may also include non-transitory media, such as secondary orpersistent long term storage, like read only memory (ROM), optical ormagnetic disks, compact-disc read only memory (CD-ROM), for example. Thecomputer readable media may also be any other volatile or non-volatilestorage systems. The computer readable medium may be considered acomputer readable storage medium, for example, or a tangible storagedevice. In addition, for the method 700 and other processes and methodsdisclosed herein, each block in FIG. 7 may represent circuitry that iswired to perform the specific logical functions in the process.

Method 700 begins at block 702, which includes receiving a voice commandfor a media playback system. In some embodiments, receiving a voicecommand includes the media playback system receiving a voice command viaone or more of PBDs 532, 534, 536, and 538 and/or computing device 506(which is configured as a media playback system server). In one example,the computing device 506 may convert the voice command to an equivalenttext command, and parse the text command to identify a command.

In some embodiments, one or more functions may be performed by thenetworked microphone system individually or in combination with themedia playback system. In some embodiments, receiving a voice commandincludes the networked microphone system receiving a voice command viaone or more of NMDs 512, 514, or 516, and transmitting the voice commandto computing device 506 and/or one or more of PBDs 532, 534, 536, and538 for further processing. In some embodiments, computing device 506and/or one or more of PBDs 532, 534, 536, and 538 may convert the voicecommand to an equivalent text command, and parse the text command toidentify a command. In some embodiments, the networked microphone systemmay convert the voice command to an equivalent text command and transmitthe text command to computing device 506 and/or one or more of PBDs 532,534, 536, and 538 to parse the text command and identify a command.

Next, method 700 advances to block 704, which includes determiningwhether the voice command was received from a registered user of themedia playback system. In some embodiments, determining whether thevoice command was received from a registered user may include computingdevice 506 determining whether there is a user profile stored on themedia playback system that is associated with the voice command. Forexample, computing device 506 may try to match the voice command toinformation identifying a user's voice in a user profile.

In some embodiments, determining whether the voice command was receivedfrom a registered user may include determining whether the voice commandmatches the voice inputs stored in the media playback system's voiceconfiguration settings. For example, a user may have previouslyconfigured the media playback system to recognize the user's voice byproviding a voice input or a series of voice inputs for the mediaplayback system to recognize and associate the user with. Voiceconfiguration settings may be stored on the computing device 506 and/orone or more of PBDs 532, 534, 536, and 538. Alternatively, the computingdevice 506 may communicate with the networked microphone system to storethe voice configuration settings.

In some embodiments, determining whether the voice command was receivedfrom a registered user may include determining a confidence levelassociated with a voice command received. The confidence level may be aconfidence level associated with the person who spoke the command, e.g.,a confidence level that the command was received from a registered usergenerally, a confidence level that the command was received from aspecific registered user, a confidence level that the command wasreceived from someone other than a registered user, a confidence levelthat the command was received from a registered guest, a confidencelevel that the command was received from a child, and/or a confidencelevel that the command was received from a particular child. Theconfidence level may also be a confidence level associated with thecontent of the request, e.g., a confidence level that the request was arequest to play “AC/DC” rather than, for example, “Hayseed Dixie,” whichare two very different bands with very similar sounding names. Theconfidence level may be determined based on user history, location,individually or in combination with any other information generallyfound in a user profile. In operation, determination of the confidencelevel may be performed by any one or more of CR 522, PBDs 532-538, NMDs512-516, and/or computing devices 504-508, individually or incombination.

For example, in some embodiments, the media playback system receives avoice command from a registered user in the kitchen and determines aconfidence level based on the voice command received. In operation, themedia playback device may receive the voice command from any one or moreof CR 522, NMDs 512-516, and/or PBDs 532-538. Next, the media playbacksystem receives the same voice command from the registered user inanother room in the user's house and determines a confidence level basedon the voice command received. The media playback system may thendetermine a new confidence level based on the received commands fromdifferent devices in different rooms throughout the user's house, basedat least in part on the room where the voice command was received. As aresult, the media playback system may have a greater confidence levelthat the voice command was received from a registered user.

In another example, the media playback system may receive a voicecommand from a registered user and determine a confidence level based onuser history. In particular, the media playback system may determine ahigher confidence level if the voice command received includes anartist, playlist, genre, or any other information found in a userprofile that is typically associated with the registered user. Forexample, if a registered user typically listens to songs by MichaelJackson, the media playback system may have a greater confidence levelthat the voice command to “Play Thriller” was received from a registereduser. Likewise, if the registered user typically listens to songs byMichael Jackson or songs from the 1980's in general, the media playbacksystem may have a greater confidence level that the voice command to“Play Thriller” is a command to play the song “Thriller” by the artistMichael Jackson rather than the song “Thriller” by the band Fall OutBoy. Many other examples, similar and different from the above, arepossible.

In some embodiments, the media playback system may build a confidencelevel based on a registered user's pattern of voice commands found in auser's profile. For example, the media playback system may receive avoice command from a registered user to play a particular song byBritney Spears, and determine a confidence level based on the receivedvoice command. Every time the media playback system receives the samevoice command or similar voice command, such as a command to playanother song by Britney Spears, the media playback system may build ahigher confidence level and may have a greater confidence level that thevoice command was received from that registered user.

Finally, method 700 advances to block 706, which includes in response todetermining that the voice command was received from a registered user,configuring an instruction for the media playback system based oncontent from the voice command and information in a user profile for theregistered user.

In some embodiments, the content from the voice command may include acommand for one or more PBDs of the media playback system to play mediacontent. In some embodiments, based on the command for one or more PBDsto play media content and information in a user profile for theregistered user, the computing device 506 may configure an instructionor a set of instructions to cause the media playback system to obtainmedia or audio content from a preferred media source of a registereduser.

In some embodiments, based on the command for the media playback systemto play media content and information in a user profile for theregistered user, the media playback system may configure an instructionor a set of instructions to cause the media playback system to play themedia content via one or more PBDs of the media playback system.

In some embodiments, based on the command for the media playback systemto play media content and information in a user profile for theregistered user, the computing device 506 may include instructions to(i) configure the media playback system with one or more of theregistered user's preferred playback settings and (ii) cause one or morePBDs of the media playback system to play the media content with theregistered user's preferred playback settings. Preferred playbacksettings may be preferred playback settings stored in a registereduser's user profile. Additionally or alternatively, preferred playbacksettings may be based on user history stored in a registered user's userprofile. User history may include commonly used or previously usedplayback settings by the user to play media content.

In some embodiments, the content from the voice command may include acommand for one or more PBDs of the media playback system to play mediacontent but may not identify a particular listening zone or playbackzone of the media playback system. Based on this content and informationin a user profile for the registered user, such as user history,computing device 506 may configure an instruction or a set ofinstructions to cause the media playback system to play the mediacontent via one or more media playback devices within the particularplayback zone of the media playback system.

In some embodiments, the content from the voice command may include acommand for the media playback system to modify a playback setting.Based on the command for the media playback system to modify a playbacksetting and information in a user profile for the registered user,computing device 506 may (i) configure an instruction or a set ofinstructions to cause the media playback system to modify the playbacksetting for one or more PBDs of the media playback system, and (ii)implement the configured instruction or set of instructions to modifythe playback setting via the one or more PBDs.

Some embodiments include the media playback system determining whetherthe voice command was received from a child. In some embodiments, thecomputing device 506 may distinguish between an adult and a child basedon information in a user profile if the child is one of the registeredusers of the media playback system. In some embodiments, the computingdevice 506 may distinguish between an adult and a child based on thetone or frequency of the user's voice.

In some embodiments, determining whether the voice command was receivedfrom a child may include determining a confidence level associated witha received voice command. As described above, a confidence level may bedetermined based on user history, location, individually or incombination with any other information generally found in a userprofile.

For example, the media playback system may receive a voice command via adevice (e.g., any of NMDs 512-516 or PBDs 532-538) in a particular roomwhere a child is likely to be (e.g., child's bedroom, playroom,basement, etc). Because the command was received from a device locatedin a room where a child is likely to be, the media playback system mayhave a greater confidence level that the voice command was received froma child.

In another example, the media playback system may receive a voicecommand and determine a confidence level that the command was receivedfrom a child based on the content of the voice command. For example, ifthe media playback system receives a voice command to play a song from acartoon show or movie, the media playback system may have a greaterconfidence level that the voice command was received from a child. Manyother examples, similar and different from the above, are possible.

In response to determining that the voice command was received from achild, some embodiments may prevent one or more PBDs of the mediaplayback system from playing given media that may be inappropriate forthe child. Some embodiments may prevent the computing device 506 and/orone or more PBDs from modifying a playback setting based on the contentof a child's voice command. For example, the computing device 506 maydisregard a child's voice command to increase the volume of one or morePBDs.

Some embodiments include actions based on determining whether a voicecommand was received from a guest user instead of a registered user ofthe media playback system. In some embodiments, computing device 506 mayhave stored a previously created guest profile that may be associatedwith a particular guest. In some embodiments, computing device 506 maydetermine that a voice command was not received from a registered user,and may then ask the registered user if the voice command came from aguest.

In some embodiments, determining whether the voice command was receivedfrom a guest user may include the media playback system determining aconfidence level associated with a voice command received. As describedabove, a confidence level may be determined based on user history,location, individually or in combination with any other informationgenerally found in a user profile.

In response to determining that the voice command was received from aguest user, computing device 506 may (1) assign a restriction settingfor the guest user, (2) configure an instruction for one or more PBDsbased on content from the voice command and the assigned restrictionsetting for the guest user, and (3) send the instruction to one or morePBDs for execution. In some embodiments, assigning a restriction settingfor a guest user may include computing device 506 matching the voicecommand to a particular guest profile stored on the computing device506. The guest profile may include restriction settings, and informationregarding the voice of the particular guest user, such as frequency ortone of the guest's voice, among other information previously described.A restriction setting may be any setting that limits the control of themedia playback system.

Some embodiments include the media playback system applying an order ofpreference to resolve conflicting voice commands received from differentusers. Conflicting voice commands may be, for example, a voice commandreceived from a user to play a song and a subsequent voice commandreceived from another user to stop playing the song. Other examples arepossible, such as a voice command received from a user to increase thevolume of one or more playback devices (e.g., PBDs 532, 534, 536, and538) and a subsequent voice command received from another user todecrease the volume. In particular, the media playback system mayreceive a voice command from a registered user or host to play a song ina playback zone. Subsequently, the media playback system may receive aconflicting voice command from a nonregistered user or guest to stopplaying the song in the playback zone. To resolve this conflict, themedia playback system may apply an order of preference in which voicecommands received from a registered user have a higher priority thanvoice commands from a nonregistered user or guest.

In some embodiments, the media playback system may assign an order ofpreference in which voice commands received from registered guests havea higher priority than voice commands received from nonregisteredguests. In some embodiments, voice commands received from one registeredguest may have a higher priority than another registered guest.Additionally or alternatively, voice commands received from an adult mayhave a higher priority than a child.

In still further embodiments, controller-issued commands received by themedia playback system (e.g., commands received from CR 522 or othercomputing devices configured to control the media playback system, orperhaps commands received from computing device 506) may have a lowerpriority than a registered user, but may have a higher priority than anonregistered user or guest. In some embodiments, some registered guestmay have a higher priority than controller-issued commands. Otherexamples of determining and assigning an order of preference arepossible.

After configuring an instruction or set of instructions for the mediaplayback system, some embodiments may send the instruction or set ofinstructions to one or more PBDs of the media playback system to executethe instructions. In some embodiments, the computing device 506 may sendthe instruction or set of instructions to the networked microphonesystem.

Method 800 shown in FIG. 8 presents an embodiment of a method that canbe implemented within an operating environment including or involving,for example, the media playback system 100 of FIG. 1, one or moreplayback devices 200 of FIG. 2, one or more control devices 300 of FIG.3, the user interface of FIG. 4, and/or the configuration shown in FIG.5. Method 800 may include one or more operations, functions, or actionsas illustrated by one or more of blocks 802-806. Although the blocks areillustrated in sequential order, these blocks may also be performed inparallel, and/or in a different order than those described herein. Also,the various blocks may be combined into fewer blocks, divided intoadditional blocks, and/or removed based upon the desired implementation.

In addition, for the method 800 and other processes and methodsdisclosed herein, the flowchart shows functionality and operation of onepossible implementation of some embodiments. In this regard, each blockmay represent a module, a segment, or a portion of program code, whichincludes one or more instructions executable by one or more processorsfor implementing specific logical functions or steps in the process. Theprogram code may be stored on any type of computer readable medium, forexample, such as a storage device including a disk or hard drive. Thecomputer readable medium may include non-transitory computer readablemedium, for example, such as tangible, non-transitory computer-readablemedia that stores data for short periods of time like register memory,processor cache and Random Access Memory (RAM). The computer readablemedium may also include non-transitory media, such as secondary orpersistent long term storage, like read only memory (ROM), optical ormagnetic disks, compact-disc read only memory (CD-ROM), for example. Thecomputer readable media may also be any other volatile or non-volatilestorage systems. The computer readable medium may be considered acomputer readable storage medium, for example, or a tangible storagedevice. In addition, for the method 800 and other processes and methodsdisclosed herein, each block in FIG. 8 may represent circuitry that iswired to perform the specific logical functions in the process.

Method 800 begins at block 802, which includes receiving a wakeup wordor wakeup phrase associated with a voice command for a media playbacksystem. A wakeup word or phrase, as described above, may be a specificword or phrase (e.g., “Hey, Sonos”) stored in a user profile. In someembodiments, the media playback system, may receive a universal wakeupword or phrase (e.g., “Hey Sonos”) associated with a voice command of aregistered user. Additionally or alternatively, the media playbacksystem may receive a universal wakeup word or phrase associated with avoice command of a registered guest user. In some embodiments, the mediaplayback system may be configured for different registered users to havedifferent wake up words or phrases.

In some embodiments, a registered user may have a different,user-specific wakeup word or phrase for different voice commands. Forexample, the media playback system may receive a wakeup word or phraseto add songs to a play queue (e.g., “Hey Sonos, let's queue up songs”“Yo, Sonos, queue songs,” “Alpha song queue,” etc), and may receive adifferent user-specific wake up word or phrase to authorize guests in ahouse to control the media playback device (e.g., “Hey Sonos, openaccess,” “It's party time,” etc).

Next, method 800 advances to block 804, which includes determiningwhether the wakeup word associated with the voice command was receivedfrom a registered user of the media playback system. In someembodiments, determining whether the wakeup word associated with a voicecommand was received from a registered user may be similar todetermining whether a voice command was received from a registered userdescribed in block 704 for method 700.

Finally, method 800 advances to block 806, which includes in response todetermining that the wakeup word associated with the voice command wasreceived from a registered user, configuring an instruction for themedia playback system based on the received wakeup word, content fromthe voice command, and information in a user profile for the registereduser.

In some embodiments, the instruction for the media playback system mayinclude an instruction to open a time period or window for the mediaplayback system to receive additional voice commands associated with thereceived wakeup word from the registered user, a guest, and/or anonregistered user. For example, in response to determining that thewakeup word to add songs to a play queue was received from a registereduser, the media playback system may open a time period (e.g., fiveminutes) for the registered user to send additional voice commands toadd specific songs to the play queue (e.g., “Add Thriller by MichaelJackson”).

In another example, in response to determining that the wakeup word toauthorize all guests to control the media playback system was receivedfrom a registered user, the media playback system may open a time period(e.g., one hour) to allow all guests in a house to send voice commandsto add songs to a play queue, play songs, or change the volume, amongother functions for a user-defined or default time period or window.

Next, method 800 advances to block 806, which includes in response todetermining that the wakeup word was received from a registered user,determining whether the wakeup word is associated with a restrictionsetting based on the received wakeup word or phrase, content from thevoice command, and information in a user profile for the registereduser.

In some embodiments, the media playback system may configure aninstruction based on restriction settings in a user profile for theregistered user or registered guest user. A wakeup word received from aregistered user may be associated with restriction settings for certainguests. For example, a registered user or host may send a voice command(e.g., “Hey Sonos, restrict control for my living room to authorizedguests”) that authorizes registered guests to send additional voicecommands for a time period or window to control one or more PBDs 532,534, 536, and 538 and/or computing device 506 in a playback zone, whilepreventing nonregistered guests from sending additional voice commands.In yet another example, the wake up word received may be associated withrestriction settings for a child. Many other examples, similar anddifferent from the above, are possible, including but not limited to theexamples described elsewhere herein.

In some embodiments, a wakeup word received from a registered user maybe associated with restriction settings that allow certain guests tohave restricted control of the media playback system for a time periodor window. U.S. Patent Pub. No. 2013/0346859 entitled, “Systems,Methods, Apparatus, and Articles of Manufacture to Provide aCrowd-Sourced Playlist with Guest Access,” which is hereby incorporatedby reference, provides in more detail some examples for restrictedcontrol of the media playback system.

In some embodiments, in response to determining that a wakeup word orwakeup phrase was received from a guest user, the media playback systemmay (i) determine whether there is a restriction setting associated withthe guest user, (ii) configure an instruction for one or more PBDs basedon the wakeup word or phrase and the assigned restriction setting forthe guest user, and (iii) send the instruction to one or more PBDs forexecution (e.g., to open a time period or window to receive additionalvoice commands associated with the wake up word command).

In some embodiments, the media playback device, via the one or more PBDs532, 534, 536, and 538 and/or computing device 506, may refrain fromtaking actions based on receiving a wakeup word or phrase from aregistered guest user if, for example, the media playback system hasalready received a voice command with a wakeup word or phrase from aregistered user or host, and the time period or window to receiveadditional commands has not expired.

After configuring an instruction or set of instructions for the mediaplayback system, some embodiments may include sending commands or set ofcommands to one or more PBDs of the media playback system to execute theinstructions. In some embodiments, the computing device 506 may send thecommands or set of commands to one or more PBDs of the media playbacksystem.

In some embodiments, after configuring an instruction or set ofinstructions for the media playback system to execute, a registered useror host may close or key off the time period or window for receivingadditional voice commands associated with the instruction. For example,if a registered user or host sends a voice command with a wake up wordor phrase that opens a time period or window to receive additional voicecommands for an hour, the registered user or host may send another voicecommand (e.g., “Hey Sonos, queue songs complete”) to key off the onehour time period or window before the one hour time period expires. Manyother examples, similar and different from the above, are possible.

In some embodiments, the media playback system may take actions based onreceiving a wakeup word or wakeup phrase from a registered guest userand subsequently close or key off the time period or window forreceiving additional voice commands if the media playback devicesubsequently receives a voice command from a registered user or host. Insome embodiments, the registered guest may close or key off the timeperiod or window before it expires. In other embodiments, an adult mayclose or key off the time period or window before it expires if theregistered guest is a child. Many other examples, similar and differentfrom the above, are possible.

IV. Conclusion

The description above discloses, among other things, various examplesystems, methods, apparatus, and articles of manufacture including,among other components, firmware and/or software executed on hardware.It is understood that such examples are merely illustrative and shouldnot be considered as limiting. For example, it is contemplated that anyor all of the firmware, hardware, and/or software aspects or componentscan be embodied exclusively in hardware, exclusively in software,exclusively in firmware, or in any combination of hardware, software,and/or firmware. Accordingly, the examples provided are not the onlyway(s) to implement such systems, methods, apparatus, and/or articles ofmanufacture.

Additionally, references herein to “embodiment” means that a particularfeature, structure, or characteristic described in connection with theembodiment can be included in at least one example embodiment of aninvention. The appearances of this phrase in various places in thespecification are not necessarily all referring to the same embodiment,nor are separate or alternative embodiments mutually exclusive of otherembodiments. As such, the embodiments described herein, explicitly andimplicitly understood by one skilled in the art, can be combined withother embodiments.

The specification is presented largely in terms of illustrativeenvironments, systems, procedures, steps, logic blocks, processing, andother symbolic representations that directly or indirectly resemble theoperations of data processing devices coupled to networks. These processdescriptions and representations are typically used by those skilled inthe art to most effectively convey the substance of their work to othersskilled in the art. Numerous specific details are set forth to provide athorough understanding of the present disclosure. However, it isunderstood to those skilled in the art that certain embodiments of thepresent disclosure can be practiced without certain, specific details.In other instances, well known methods, procedures, components, andcircuitry have not been described in detail to avoid unnecessarilyobscuring aspects of the embodiments. Accordingly, the scope of thepresent disclosure is defined by the appended claims rather than theforgoing description of embodiments.

When any of the appended claims are read to cover a purely softwareand/or firmware implementation, at least one of the elements in at leastone example is hereby expressly defined to include a tangible,non-transitory medium such as a memory, DVD, CD, Blu-ray, and so on,storing the software and/or firmware.

We claim:
 1. Tangible, non-transitory computer-readable media havinginstructions encoded thereon, wherein the instructions, when executed byone or more processors, cause a computing device to perform a methodcomprising: storing in association with a first user profile for a mediaplayback system, (i) a first wakeup word and (ii) a first user accountwith a music service; storing in association with a second user profilefor the media playback system, (i) a second wakeup word and (ii) asecond user account with the music service; receiving, via a microphoneof the computing device, a first voice input comprising (i) the firstwakeup word, and (ii) a first voice command for the media playbacksystem; in response to receiving the first voice input, identifying thefirst user profile based on the first wakeup word and configuring afirst instruction based on (i) the first voice command and (ii) thefirst user account with the music service; transmitting the configuredfirst instruction to the music service; wherein the first wakeup wordtriggers a time period for the media playback system to receiveadditional voice commands; after the time period has expired, receiving,via the microphone of the computing device, a second voice inputcomprising (i) the second wakeup word, and (ii) a second voice commandfor the media playback system; in response to receiving the second voiceinput, (i) identifying the second user profile based on the secondwakeup word and (ii) determining whether the second user profile haspermission to control the media playback system; in response todetermining that the second user profile has permission to control themedia playback system, configuring a second instruction based on (i) thesecond voice command and (ii) the second user account at the musicservice; and transmitting the configured second instruction to the musicservice.
 2. The tangible, non-transitory computer-readable media ofclaim 1, wherein the first voice command is a command for the mediaplayback system to play media content, and wherein configuring the firstinstruction comprises configuring the first instruction to cause themedia playback system to obtain the media content from the music servicevia the first user account with the music service.
 3. The tangible,non-transitory computer-readable media of claim 1, wherein the firstuser profile is further associated with a particular playback zone ofthe media playback system, wherein the first voice command is a commandfor the media playback system to play media content, wherein the firstvoice command does not identify a playback zone, and wherein configuringthe first instruction comprises configuring the first instruction tocause the media playback system to play the media content in theparticular playback zone of the media playback system.
 4. The tangible,non-transitory computer-readable media of claim 1, wherein the firstuser profile is further associated with one or more playback settings,wherein the first voice command is a command for the media playbacksystem to play media content, and wherein configuring the firstinstruction comprises configuring the first instruction to cause themedia playback system to play the media content according to the one ormore playback settings associated with the first user profile.
 5. Thetangible, non-transitory computer-readable media of claim 4, wherein theone or more playback settings associated with the first user profilecomprise one or more of (i) a preferred playback volume and (ii) apreferred audio equalization setting.
 6. The tangible, non-transitorycomputer-readable media of claim 1, wherein determining whether thesecond user profile has permission to control the media playback systemcomprises identifying one or more access restrictions associated withthe second user profile, and wherein configuring the second instructioncomprises configuring the second instruction based on (i) the secondvoice command and (ii) the identified one or more access restrictions.7. The tangible, non-transitory computer-readable media of claim 1,wherein the method further comprises: storing data indicating that thecomputing device corresponds to a default playback zone of the mediaplayback system; after transmitting the first instruction to the musicservice, receiving media content corresponding to the first instructionfrom the music service; and transmitting the media content correspondingto the first instruction to the default playback zone.
 8. The tangible,non-transitory computer-readable media of claim 1, wherein the firstuser profile is further associated with a first playback zone of themedia playback system, wherein the first voice command is a command forthe media playback system to play media content in a second playbackzone of the media playback system different from the first playbackzone, and wherein configuring the first instruction comprisesconfiguring the first instruction to cause the media playback system toplay the media content in the second playback zone of the media playbacksystem.
 9. A computing device comprising: one or more processors; andtangible, non-transitory computer-readable media having instructionsencoded thereon, wherein the instructions, when executed by the one ormore processors, cause the computing device to perform a methodcomprising: storing in association with a first user profile for a mediaplayback system, (i) a first wakeup word and (ii) a first user accountwith a music service; storing in association with a second user profilefor the media playback system, (i) a second wakeup word and (ii) asecond user account with the music service; receiving, via a microphoneof the computing device, a first voice input comprising (i) the firstwakeup word, and (ii) a first voice command for the media playbacksystem; in response to receiving the first voice input, identifying thefirst user profile based on the first wakeup word and configuring afirst instruction based on (i) the first voice command and (ii) thefirst user account with the music service; transmitting the configuredfirst instruction to the music service; wherein the first wakeup wordtriggers a time period for the media playback system to receiveadditional voice commands; after the time period has expired, receiving,via the microphone of the computing device, a second voice inputcomprising (i) the second wakeup word, and (ii) a second voice commandfor the media playback system; in response to receiving the second voiceinput, (i) identifying the second user profile based on the secondwakeup word and (ii) determining whether the second user profile haspermission to control the media playback system; in response todetermining that the second user profile has permission to control themedia playback system, configuring a second instruction based on (i) thesecond voice command and (ii) the second user account at the musicservice; and transmitting the configured second instruction to the musicservice.
 10. The computing device of claim 9, wherein the first voicecommand is a command for the media playback system to play mediacontent, and wherein configuring the first instruction comprisesconfiguring the first instruction to cause the media playback system toobtain the media content from the music service via the first useraccount with the music service.
 11. The computing device of claim 9,wherein the first user profile is further associated with a particularplayback zone of the media playback system, wherein the first voicecommand is a command for the media playback system to play mediacontent, wherein the first voice command does not identify a playbackzone, and wherein configuring the first instruction comprisesconfiguring the first instruction to cause the media playback system toplay the media content in the particular playback zone of the mediaplayback system.
 12. The computing device of claim 9, wherein the firstuser profile is further associated with one or more playback settings,wherein the first voice command is a command for the media playbacksystem to play media content, and wherein configuring the firstinstruction comprises configuring the first instruction to cause themedia playback system to play the media content according to the one ormore playback settings associated with the first user profile.
 13. Thecomputing device of claim 9, wherein determining whether the second userprofile has permission to control the media playback system comprisesidentifying one or more access restrictions associated with the seconduser profile, and wherein configuring the second instruction comprisesthe computing device configuring the second instruction based on (i) thesecond voice command and (ii) the identified one or more accessrestrictions.
 14. The computing device of claim 9, wherein the firstuser profile is further associated with a first playback zone of themedia playback system, wherein the first voice command is a command forthe media playback system to play media content in a second playbackzone of the media playback system different from the first playbackzone, and wherein configuring the first instruction comprisesconfiguring the first instruction to cause the media playback system toplay the media content in the second playback zone of the media playbacksystem.
 15. A method comprising: a computing device storing inassociation with a first user profile for a media playback system, (i) afirst wakeup word and (ii) a first user account with a music service;the computing device storing in association with a second user profilefor the media playback system, (i) a second wakeup word and (ii) asecond user account with the music service; receiving, via a microphoneof the computing device, a first voice input comprising (i) the firstwakeup word, and (ii) a first voice command for the media playbacksystem; in response to receiving the first voice input, the computingdevice identifying the first user profile based on the first wakeup wordand configuring a first instruction based on (i) the first voice commandand (ii) the first user account with the music service; the computingdevice transmitting the configured first instruction to the musicservice; wherein the first wakeup word triggers a time period for themedia playback system to receive additional voice commands; after thetime period has expired, receiving, via the microphone of the computingdevice, a second voice input comprising (i) the second wakeup word, and(ii) a second voice command for the media playback system; in responseto receiving the second voice input, the computing device (i)identifying the second user profile based on the second wakeup word and(ii) determining whether the second user profile has permission tocontrol the media playback system; in response to determining the seconduser profile has permission to control the media playback system, thecomputing device configuring a second instruction based on (i) thesecond voice command and (ii) the second user account at the musicservice; and the computing device transmitting the configured secondinstruction to the music service.
 16. The method of claim 15, whereinthe first voice command is a command for the media playback system toplay media content, and wherein configuring the first instructioncomprises configuring the first instruction to cause the media playbacksystem to obtain the media content from the music service via the firstuser account with the music service.
 17. The method of claim 15, whereinthe first user profile is further associated with a particular playbackzone of the media playback system, wherein the first voice command is acommand for the media playback system to play media content, wherein thefirst voice command does not identify a playback zone, and whereinconfiguring the first instruction comprises configuring the firstinstruction to cause the media playback system to play the media contentin the particular playback zone of the media playback system.
 18. Themethod of claim 15, wherein the first user profile is further associatedwith one or more playback settings, wherein the first voice command is acommand for the media playback system to play media content, and whereinconfiguring the first instruction comprises configuring the firstinstruction to cause the media playback system to play the media contentaccording to the one or more playback settings.
 19. The method of claim15, further comprising: the computing device storing data indicatingthat the computing device corresponds to a default playback zone of themedia playback system; after transmitting the first instruction to themusic service, receiving media content corresponding to the firstinstruction from the music service; and transmitting the media contentcorresponding to the first instruction to the default playback zone. 20.The method of claim 15, wherein the first user profile is furtherassociated with a first playback zone of the media playback system,wherein the first voice command is a command for the media playbacksystem to play media content in a second playback zone of the mediaplayback system different from the first playback zone, and whereinconfiguring by the computing device, the first instruction comprisesconfiguring by the computing device, the first instruction to cause themedia playback system to play the media content in the second playbackzone of the media playback system.